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ABSTRACT 


The  importance  of  mathematical  models  as  tools  in 
decision  making  has  motivated  increased  interest  in  that 
theory  and  its  implementation.  This  paper  describes  funda¬ 
mental  techniques  of  linear  programming  which  have  been 
cosibined  to  offer  a  microcomputer  based  optimization 
package.  The  package  is  machine  portable  and  will  accept 
input  from  files  created  by  other  programs.  Thus  the 
package  affords  the  opportunity  to  build  a  mathematical 
programming  system  based  on  its  ability  to  solve  bounded 
variable  linear  sub-problems.  Written  in  JRT  PASCAL  3.0 
and  implemented  on  a  portable,  8-bit  microcomputer  (KAYP Ro¬ 
ll)  ,  this  package  places  the  fundamental  tool  of  optimiza¬ 
tion  in  the  office,  classroom  and  home. 
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I .  INTRODUCTION 


In  the  past  35  years,  thousands  of  papers  have  been 
published  dealing  with  decision  theory  and  optimization. 

In  the  development  of  that  theory,  the  study  of  solutions 
to  systems  of  linear  inequalities  has  played  a  large  role. 

The  importance  of  mathematical  models  as  tools  in  decision¬ 
making  has  motivated  increased  interest  in  that  theory 
and  its  implementation . 

Linear  programming  is  the  minimization  of  a  linear 
function  subject  to  linear  inequality  constraints  [Ref.  1] . 

The  techniques  applied  to  this  area  of  optimization  are 
rooted  in  the  theory  of  solutions  to  systems  of  linear  inequali¬ 
ties  and  the  mathematics  of  linear  equation  theory.  Appli¬ 
cations  of  this  theory  provide  insight  into  the  problem  of 
minimizing  a  convex  function  whose  variables  must  satisfy  a 
system  of  convex  inequality  constraints.  The  applications 
also  provide  a  framework  for  extending  problems  in  mathe¬ 
matical  statistics  and  a  foundation  upon  which  are  built 
sodern  algorithms  for  the  solution  of  optimization  problems 
whose  variables  are  integer  valued  (integer  programming) 
or  whose  constraints  are  non-linear  (non-linear  programming) . 

Due  to  this  wide  range  of  applications,  the  availability  of 
efficient  implementations  of  linear  programming  algorithms 
has  becosM  important.  Routines  to  solve  a  wide  variety  of 
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problems  have  been  developed  for  use  on  mainframe  computers . 
Many  competitive  businesses  and  industries  routinely  rely 
on  such  programs  to  assist  in  day-to-day  corporate  decision 
making.  These  systems  tend  to  be  expensive  to  operate  due 
to  overhead  costs  associated  with  the  operation  of  large- 


scale  computer  hardware  and  the  training  of  operators  of 
time-share  systems. 

The  microcomputer  is  fast  becoming  a  viable  alternative 
to  time-share  mainframes  as  a  source  of  computational  power 
for  small  businesses  and  individuals.  Rapid  advances  in 
computer  technology,  especially  in  micro-electronioe,  have 
made  possible  the  routine  use  of  many  of  the  basic,  theoreti¬ 
cal  algorithms  which  were  previously  viewed  as  too  complex 
and  inefficient.  The  incorporation  of  these  advances  into 
the  manufacture  of  "micros"  and  the  development  of  micro- 
computer-based  programming  languages  responsive  to  user 
needs  have  only  recently  allowed  for  implementation  of 
fundamental  optimization  tools  on  the  relatively  inexpensive 
microcomputer.  Obvious  trade-offs  arise  in  the  comparison 
of  "micros"  to  mainframes.  While  the  speed  at  which  large 
computers  accomplish  computational  results  is  surely  their 
greatest  asset,  so  are  size  and  the  costs  of  hardware  and 
software  their  greatest  liabilities.  On  the  other  hand, 
the  relatively  inexpensive  one-time  purchase  price  of 
the  microcomputer  and  its  associated  software  must  be 
somewhat  offset  by  its  slower  computational  speed  and  smaller 
memory  size. 
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Another  disadvantage  of  the  microcomputer  is  that  effi¬ 
cient,  "user-friendly"  optimization  systems  are  not  cur¬ 
rently  available  for  the  microcomputer  environment.  This 
is  possibly  due,  in  part,  to  the  intense  effort  required  to 
develop  sophisticated  microcomputer  software  in  this  severely 
restricted  environment.  While  a  few  basic  implementations 
of  linear  programming  optimization  theory  are  beginning  to 
appear,  no  reference  to  any  work  of  consequence  has  been 
found  in  the  literature.  Further,  it  is  not  clear  that  the 
advantages  of  the  microcomputer  have  been  fully  exploited 
in  those  few  systems  currently  being  released.  In  fact  it 
is  apparent  that  so-called  microcomputer  based  systems  are 
usually  weaker  versions  of  systems  designed  and  implemented 
for  mainframes  from  simple  textbook  descriptions  and  modi¬ 
fied  for  use  on  a  microcomputer;  the  elesMntary  theory 
incorporated  limits  problem  size  and  solution  efficiency 
due  to  insensitivity  to  the  strengths  and  weaknesses  of  the 
target  computer.  Few  of  the  sophisticated  features  of  widely 
available  commercial,  mainframe  optimization  systems  have 
been  transferred  to  "micros". 

The  following  is  an  attempt  to  amalgamate  current 
technology  and  fundamental  theory  regarding  linear  pro¬ 
gramming  and  to  create  an  easy-to-use,  interactive  computer 
program  with  wide  applicability  on  current  state-of-the-art 
microcomputers.  The  system  described  is  designed  for  a  most 
restrictive  "eight-bit"  microcomputer  in  the  hope  that 
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upward  compatability  with  larger  machines  and  new-generation 
computers  will  allow  more  advanced  capabilities  as  technology 
admits  in  the  future.  The  algorithms  described  and  imple¬ 
mented  range  in  complexity  from  simple  algebraic  manipula¬ 
tion,  as  in  the  simplex  pivot,  to  the  more  involved  technique 
of  the  preassigned  pivot  procedure  initially  developed  by 
Hellerman  and  Rarick  [Ref.  2] .  Subtle  modifications  have 
been  made  to  many  of  the  basic  algorithms  to  allow  implemen¬ 
tation  on  the  microcomputer.  Other  algorithms  have  been 
embedded  in  the  code  and  are  activated  where  required,  e.g., 
a  new  modification  of  Bland's  first  rule  for  the  avoidance 
of  cycling  in  the  presence  of  degeneracy  [Ref.  3] .  In  the 
section  dealing  with  the  use  of  the  program,  the  input  and 
output  routines  are  discussed. 

The  package  employs  a  reasonable  number  of  "large- 
scale"  optimization  features,  including  sparce  problem  repre¬ 
sentation  and  product  form  inverse.  The  limits  on  the  size 
of  problems  that  these  programs  can  cope  with  is  principally 
dependent  on  the  size  and  bit  density  of  the  off-line  stor¬ 
age  available  and  the  size  of  internal  random  access  memory 
(RAM) .  Numerous  vectors  are  implemented  whose  dimensions 
are  problem  dependent  and  allocated  at  run-time,  providing 
true  dynamic  dimensioning.  "In  core,  out  of  core"  operation 
maximizes  RAM  utilization  in  a  fashion  reminiscent  of  second 
generation  mainframe  computers  two  decades  old. 

JRT  Pascal  version  3.0  is  used  to  implement  the  theory 
discussed  in  this  thesis.  The  program  modules  are  compiled 


on  the  KAYPRO  II,  eight-bit  microcomputer.  The  associated 
algorithm  is  designed  based  on  speed  (number  of  calcula¬ 
tions  required) ,  overhead  required,  available  programming 
language  constructs,  and  simplicity  of  theory;  usually  in 
that  order. 

Wide-spectrum  stress  testing  of  the  package  has  not 
been  performed  due  to  time  constraints. 
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II.  PROBLEM  REPRESENTATION 

In  this  chapter  we  define  a  canonical  problem  format 
(LPC)  and  the  terms  to  be  used  throughout  the  development 
of  the  algorithm.  We  then  show  that,  given  any  problem  formu¬ 
lation,  (LPF) ,  an  equivalent,  canonical  form  may  be  achieved 
through  the  application  of  simple  transformations  and/or 
the  introduction  of  additional  logical  variables  such  that 
a  solution  to  (LPF)  can  always  be  constructed  from  an 
equivalent  solution  to  (LPC) . 

Any  linear  program  is  formulated  as  follows: 


(LPF)  minimize  (or  maximize)  cx 

subject  to'  linear  equality  or  inequality 
constraints  with  variables, 

Xj  0  non-negative, 

Xj  £  0  non-positive,  or 

Xj  unrestricted  in  sign  ("free") . 


A.  CANONICAL  FORM 

The  algorithm  developed  in  this  thesis  is  designed  to 
provide  optimal  solutions  to  linear  programming  problems 
stated  in  the  following  "canonical"  form  (assuming  an  opti¬ 
mal  solution  exists) : 
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(LPC)  minimize  cx  ("objective  function") 
subject  to 


Ax  =  b,  ("constraints") 

0  <_  x  <_  UB,  (UB  are  "upper  bounds") 

b  0;  ("non-negative  right 

hand  side") 

where  x  is  an  n-dimensional  column  vector,  c  is  an  n- 
dimensional  row  vector,  A  is  an  mxn  matrix  of  technologi- 
cal  coefficients  with  n  >_  m,  and  b  is  an  m-dimensional 
column  vector.  All  (LPF)  forms  may  be  converted  to  the 
(LPC)  form  as  described  in  the  following  sections. 

B.  BASIS  DEFINITION 

A  basis,  denoted  by  B,  is  any  set  of  m  linearly 
independent  columns  of  A.  An  initial  basis,  Bq,  is  the 
first  basis  considered  in  the  iterative  solution  of  (LPC) . 
It  will  be  convenient  to  construct  an  initial  basis,  during 
the  process  of  transforming  (LPF)  to  (LPC) ,  such  that 
this  initial  basis  consists  of  unit  vectors,  i.e.,  BQ  -  I. 
In  so  doing,  the  inverse  of  the  initial  basis,  Bq^,  is 
identically  I  and  its  "product- form”,  the  implicit  repre¬ 
sentation  of  B^1  as  the  product  of  elementary  transforma¬ 
tion  matrices,  is  trivial. 


C.  MAXIMUM  VS.  MINIMUM 

Suppose  that  the  problem  (LPF)  is  stated  as: 

maximize  cx 
s.t. 

canonical  form  (LPC)  constraints. 

Since  (LPC)  requires  formulation  as  a  minimization 
it  will  be  necessary  to  transform  the  objective  function, 
maximize  cx.  The  resulting,  equivalent  minimization 
function  is: 

minimize  (-c)x;  we  redefine  c  accordingly  in  (LPC). 

Similarly,  for  each  b.  <  0  we  can  perform  a  transforma¬ 
tion  to  replace  with  b.  >  0  as  follows: 

i.  multiply  row  i  by  -1. 

ii.  replace  the  right  hand  side  element  so  that 


D.  SLACK  LOGICAL  VARIABLES 

We  must  be  concerned  with  transforming  inequality 
constraints  to  the  canonical  form.  Consider  the  (LPF) 
problem  with  the  "ith”  constraint  of  the  following  form: 

ailxl  +  ai2x2  +  •**  +  ainxn  -  bi  * 
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To  convert  this  problem  to  canonical  (LPC)  form  we 


to  as  a  "slack  variable",  or  "logical  plus  type".  Note 
that  if  some  x  satisfies  the  (LPF)  constraint,  it  also 
satisfies  the  (LPC)  constraint  and  vice  versa.  The  slack 
variable  simply  takes  on  the  value  required  to  maintain 
the  equality  in  (LPC) . 


E.  SURPLUS  LOGICAL  VARIABLES 

Suppose  that  the  ith  constraint  from  (LPC)  is  of  the 
form: 


ailxl  +  ai2x2  + 


+  a .  x  > 
in  n  — 


bi'  bi  >  °' 


then 


®ilxl  +  *i2x2  *  • 


+  ainxn  -  wi 


wi  >  0, 


The  variable  appended  here  is  called  a  "surplus 
variable"  or  "logical  minus  type"  and  again,  any  x  satis¬ 
fies  the  (LPF)  form  if  and  only  if  it  satisfies  the  (LPC) 
form.  Here  takes  on  the  value  required  to  maintain 
the  equality. 


F.  ARTIFICIAL  VARIABLES 


Considering  the  introduction  of  the  variable,  w,  into 
(LPC)  for  the  previous  case,  we  find  that  its  coefficients 
form  the  negative  of  the  i-th  unit  vector.  We  would  prefer 
to  have  available  an  initial  basis  composed  exclusively 
of  positive  unit  vectors.  By  construction  we  will  add  a 
second,  non-negative  variable  to  the  previous  equation  as 
follows : 


ailxl  +  ai2x2  + 


+  ainxn  -  wi  +  zi 


bi' 


2  .  >  0 . 
1  — 


The  variable  introduced  is  called  an  artificial  varia¬ 
ble.  Note  that  z^  >  0  in  (LPC)  implies  that  the  i-th 
constraint  in  (LPF)  is  not  satisfied.  However,  if  a  solu¬ 
tion  to  the  new  problem  can  be  found  such  that  «  0,  then* 
the  solution  to  the  new  problem  will  be  consistent  with 
the  solution  to  (LPF) . 

By  similar  convention  we  introduce  an  artificial  varia¬ 
ble  into  equality  constraints  of  (LPF)  to  produce  an  initial 
identity  basis  for  (LPC) .  Note  that  the  values  of  artificial 
variables  in  (LPC)  gauge  the  magnitudes  of  respective  con¬ 
straint  violations  in  (LPF) . 

6.  VARIABLE  BOUNDS 

Variable  bounds  are  elementary  constraints  of  the  form 


LB j  <  Xj  <  UBj  , 
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Frequently,  such  constraints  are  present  in  (LPF)  and  can 
be  expressed  as  variable  bounds  in  (LPC) .  Variable  bounds 
are  accommodated  with  great  efficiency  in  the  bounded 
variable  simplex  method,  but  they  must  be  identified 
explicitly  prior  to  the  solution. 

As  a  further  simplification,  the  lower  variable  bounds 
may  be  changed  to  be  zero  by  the  simple  transformation 
(change  of  origin) : 


(LPC) 


(LPF) 


*  xj  -  “i 


The  resulting  variables  in  (LPC)  have 


0  <  Xj  <  MUBj  -  UB j  -  LBj . 


Recovery  of  the  final  solution  to  (LPF)  from  a  solution  to 
(LPC)  is  immediate  by  reversing  the  transformation: 


(LPF)  «•  (LPC) 


*  xj +  “j 


H.  VARIABLES  WITH  UNRESTRICTED  SIGN 

An  easy  technique  available  to  deal  with  "free",  or 
"unrestricted  variables"  replaces  the  free  variable  with 


the  difference  of  two  non-negative  surrogates,  x^  =  uj  “  vj * 
Although  this  technique  introduces  an  additional  variable, 
the  overhead  cost  is  only  the  duplication  of  the  coefficients 
of  x  to  create  the  additional  variable,  and  a  final  trans¬ 
formation  to  recover  the  resulting  value  of  ,  which  is 
relatively  inexpensive.  Storage  overhead  for  the  new 
variable  is  of  little  consequence  due  to  the  use  of  the 
"out-of-core”  storage  of  non-zero  problem  elements. 

All  complications  in  (LPF)  may  now  be  handled  by  standard 
elementary  problem  transformations  to  produce  (LPC) .  Thus 
x  may  be  unrestricted  in  sign,  and  arbitrary  inequality 
constraints  can  be  accommodated  so  that  any  formulation  may 
be  easily  modified  to  produce  (LPC) . 


Ill .  ALGORITHM  SELECTION 


Once  the  problem  formulation  has  been  transformed  to 
canonical  form  (LPC) ,  an  algorithm  must  be  developed,  or 
adapted,  that  provides  the  technique  required  to  solve 
the  (LPC)  problem.  This  algorithm  must  be  both  efficient, 
and  sympathetic  to  the  eccentricities  of  the  small  computer. 
In  keeping  with  common  practice  on  microcomputers,  we  adopt 
a  straightforward,  elementary  textbook  approach  to  the 
mathematical  justification  of  our  simplex  algorithm.  The 
implementation  is  necessarily  more  sophisticated.  The 
general  algorithm  that  will  be  discussed  here  is  the  two- 
phase,  revised  simplex  method  (simplex  method  using  multi¬ 
pliers)  (Ref.  1].  Specifically,  the  non-zero  elements  of 
the  product  form  of  the  inverse  and  all  non- zero  problem 
elements  will  be  stored  in  two  random  access  diskette  files 
and  will  be  read  into  internal  memory  only  when  required. 

The  associated  reinversion  technique  used  is  the  preassigned 
pivot  procedure  [Ref.  2].  Each  section  of  the  algorithm 
will  be  discussed  in  this  chapter.  The  next  chapter  will 
be  devoted  to  the  associated  implementation. 

A.  A  GENERAL  SIMPLEX  TECHNIQUE 

Assuming  that  the  problem  statement  has  been  transformed 
to  the  form  of  (LPC),  we  may  proceed  as  follows: 
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1.  Rewrite  (LPC)  in  Terms  of  Basic  Solution 

At  any  iteration;  let  B  be  a  set  of  m  linearly 

independent  columns  of  A  which  leads  to  the  column  parti¬ 
tion  of  (LPC) : 

min  cx 

subject  to  Ax  =  b  =>  [B  |N]  x 

=  BXg  +  NXjj  =  b  . 

The  variables  Xg  are  called  basic  (or  dependent) 
with  coefficients  B,  and  the  variables  X^  are  referred  to 
as  non-basic  (or  independent)  variables  with  coefficients 
N.  It  will  be  convenient  to  index  columns  of  B  and  the 
basic  variables  ^  by  the  row  to  column  mapping  (for 
row  i,  the  associated  basic  column  and  variable  is  j^)  . 

2.  Basic  Solution 

A  basic  solution  at  any  iteration  consists  of  the 
values  of  Xg  and  X^  The  value  of  each  of  the  X^  variables 
is,  by  convention,  a  constant  equal  to  zero  or  the  asso¬ 
ciated  upper  bound.  For  illustration,  we  will  assume  all 
non-basic  variables  are  at  zero. 

The  values  of  the  basic  variables  Xg  are  defined  by 
the  problem  statement  (LPC)  as  follows: 

Since  BXg  +  NX^  -  b 

then  Xg  -  B-1b  -  b”1^ 

and  Xjj  =  °  Xg  *  B-1b  . 
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The  value  of  the  objective  function  is  defined: 

“  *  °BJt8  +  °N^N 

*  cBB'lb  +  Vn 

and  again 

Xjj  =  0  =*>  cx  *  cBB~1b  . 


3.  Priceout 

The  purpose  of  the  "priceout  step"  is  to  identify 
a  non-basic  variable  for  which  the  rate  of  improvement  in 
the  value  of  the  objective  function  is  favorable. 

Consider: 

°*  -  °BXB  +  CNXN 

-  CB  (B-1b  -  B*1^)  +  =NXN 

*  cBB”^b  +  <=N  -  CBB’ll,,XN 

*  V’1*’  +  rXN  • 

Mote  that  CgB”^)  is  the  current  value  of  the  objec¬ 
tive  function  given  X^  =  0  and  (cN  -  cbb”Hj)  is  the  vector 
of  reduced  costs,  r,  which  indicates  how  much  the  objective 
function  changes  as  changes.  This  vector,  r,  will  be 
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will  enter  the 


searched  to  determine  which  variable,  x  , 

q 

basis.  The  subscript,  q,  indexes  the  column  chosen. 

If  no  favorable  price  is  found  in  this  search,  an 
optimal  solution  is  declared  for  the  current  objective. 

4.  Ratio  Test 

The  "ratio  test"  insures  that  the  subsequent  solu¬ 
tion  will  continue  to  satisfy  all  variable  bounds.  The 
ratio  test  searches  for  the  first  variable  to  reach  one  of 
its  bounds  as  x^  increases  in  magnitude.  If  basic  variable 
x.  is  the  variable  which  first  reaches  a  bound,  0  or  UB .  , 

in  terms  of  the  incoming  variable  x  ,  then  x .  leaves  the 

q  ^i 

basis  and  x  enters.  Otherwise,  x  reaches  its  own  opposite 

H  4 

bound  before  any  basic  variable  does,  and  x^  will  not  enter 
the  basis. 

Let  Y  *  {y^j}  represent  the  updated  values  of  the 
elements  of  the  matrix  A,  with  Y^  denoting  column  j,  such 
that: 


Yj  *  B-1Aj  "updated  column", 


*0  *  B"lb 


'right  hand  side"  . 


and  recall  that  the  basic  variables  are  determined  by: 


B-1b  -  B-1I 


Then  the  variable  which  exits  the  basis  is  determined  by: 


MIN  a)  UBq»  upper  bound  on  entering  variable 

b)  min  yi0/yiq,  yiq  >  o 

c)  min(y^Q-UB.  )/  y.  ,  UB .  finite  and 

^i  1C*  ^i 

yiq  <  »• 


Let  p  be  the  index  of  the  constraint  in  which 

the  "winning"  ratio  is  found  so  that  p  =  $>  in  case  a)  , 

and  x.  is  the  leaving  variable  in  cases  b)  or  c) .  If 
IIP 

p  *  $  and  UBg  =  ®,  then  the  problem  is  unbounded:  no 

variable  reaches  a  finite  bound  as  x  increases  and  the 

<3 

value  of  the  objective  function  increases  without  limit. 

5.  Reflection 

We  have  assumed  for  convenience  that  =  0. 

Suppose  that  x^  is  bounded  so  that  0  £  x^  <  UB^ ,  and  that 
at  some  point  Xj  leaves  the  basis  at  its  upper  bound,  UB^ . 
Then  to  preserve  Xjj  =  0  and  avoid  complication  in  the  logic 
required  to  handle  this  new  type  of  variable,  we  "reflect" 
the  variable  x^ . 

The  variable  x^  is  replaced  by  UB ^  "  xj  •  We 
record  this  replacement  as  a  status  of  the  variable  x^ 
(noting  that  another  reflection  of  x^  restores  its  initial 
status) ,  and  take  care  to  modify  the  right  hand  side  with 
the  constants  AjUBj  and  treat  column  j  as  if  its  sign 


were  reversed. 


For  cases  a)  and  c)  of  the  ratio  test,  a  reflection 

is  required  in  the  update.  For  case  a) ,  no  further  work 

need  be  done  as  xq  remains  non-basic  and  B  is  unchanged. 

Otherwise,  in  cases  b)  and  c) ,  the  variable  x  enters  the 

basis  and  x.  leaves  the  basis.  In  these  cases,  an  elemen- 
JP 

tary  transformation  matrix  must  be  formed  such  that 

=  Bk+i'  where  Bk+^  is  the  inverse  of  the  new  basis 
with  xq  e  xfi  and  x^  e  xn*  In  ^is  way  a  "Pivot"  is  per¬ 
formed  about  the  element  ypq,  with: 


where  v.  -  -yiq/ypq,  i  *  p  and  vp  =  l/ypq. 

B.  TWO  PHASE  SIMPLEX 

If  the  initial  basis  includes  artificial  variables, 
the  initial  basic  solution  may  be  infeasible.  The  values 
of  these  variables  must  be  reduced  to  zero  to  obtain  a 
feasible  basic  solution,  if  one  exists.  Phase  I  of  the 
two-phase  simplex  method  accomplishes  this  task.  If 
Phase  I  produces  a  feasible  solution,  the  original  (LPC) 


objective  function  is  restored  and  Phase  II  is  begun.  Phase 
II  improves  a  basic  feasible  solution  to  optimality. 

The  first  step  in  Phase  I  is  to  introduce  a  special 
objective  function.  This  vector  contains  a  zero  for  each 
non-artificial  variable  and  positive  unity  as  a  penalty  for 
each  artificial  variable  in  the  initial  basis,  so  that 
the  objective  function  is  of  the  form: 

Phase  I  objective: 

MIN  (sum  of  the  artificial  variables) . 

The  simplex  technique  is  then  applied  until  the  priceout 
step  produces  no  favorable  (incoming)  variable.  At  this 
point  an  optimal  solution  to  the  Phase  I  problem  is  obtained. 
If  the  optimal  value  of  the  Phase  I  objective  function  is 
zero,  the  artificial  variables  all  have  zero  value  and  the 
associated  basis  provides  a  feasible  solution  to  the 
original  problem  (although  not  necessarily  optimal  for  (LPC) ) . 
If,  on  the  other  hand,  the  final  value  of  the  objective 
function  is  positive  then  not  all  of  the  artificial  varia¬ 
bles  have  a  value  of  zero.  Thus  a  feasible  solution  to 
(LPC)  does  not  exist,  and  hence  none  exists  for  (LPF) . 

During  Phase  I,  an  artificial  variable,  once  removed 
from  the  basis,  is  never  allowed  to  re-enter.  When  (LPC) 
contains  redundant  constraints,  artificial  variables  may, 
with  value  zero,  remain  as  part  of  the  basic  set  of  variables 
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I 

at  the  end  of  Phase  I  [Ref.  1,  p.  103].  It  is  necessary 
that  their  values  in  Phase  II  never  exceed  zero.  This  is 
accomplished  by  eliminating  all  non-basic  variables  whose 
reduced  costs,  r ^ ,  at  the  end  of  Phase  I  are  greater  than 
zero,  for  if  one  of  these  variables  were  introduced  into 
the  basis  during  Phase  II,  the  value  of  some  basic  artificial 
variable  would  increase  and  the  solution  would  again  become 
infeasible.  Once  this  task  is  completed  we  are  guaranteed 
that  if  artificial  variables  form  part  of  the  basic  set  of 
variables  in  the  various  iterations  of  Phase  II,  their 
values  will  never  exceed  zero.  (See  proof;  [Ref.  1,  p.  103].) 
Also,  during  Phase  II,  an  artificial  variable  is  never 
allowed  to  re-enter  the  basis. 

C.  A  BOUNDED  VARIABLE  SIMPLEX  TECHNIQUE 
1.  Transformation  of  Variables 

A  "bounded-variable"  problem  may  include  non-zero 
lower  bounds  on  values  of  variables.  Since  the  algorithm 
adopted  assumes  all  lower  bounds  are  zero,  a  transformation 
of  variables  must  be  carried  out  prior  to  the  simplex 
routine: 


and  requires  the  following  additional  bookkeeping: 

a.  For  all  variables  with  non-zero  lower  bounds,  LB, 
modify  the  upper  bound,  UB ,  such  that  the  modified 
upper  bound  MUB  ■  UB  -  LB. 
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■r- *v  •*.  v. 


b.  Modify  all  right  hand  side  values  such  that 

b!  =  b.  -  l  a. .  *  LB.  ,  for  all  i. 

j  J  J 

A  retransformation  will  be  required  to  express  the 
solution  in  terms  of  the  original  problem  statement.  Let 
b*  represent  the  right  hand  side  value  of  the  transformed 

A 

problem  at  completion  of  the  simplex  algorithm,  and  x^  repre¬ 
sent  the  value  of  the  j-th  transformed  variable.  Then 
the  transformations  required  to  arrive  at  the  solution  to 
the  original  problem  statement  are  as  follows: 

/s 

If  Xj  is  non-basic  then  x^  *  LB^  or  (MUB^  +  LB^ ) 
dependent  on  whether  the  variable  x..  is  at  its  lower  or 
upper  bound. 

A 

If  Xj  is  basic  then  the  following  cases  apply: 

CASE  (LPF)  bounds  (LPC)  transformation 

/v 

1  0  <  Xj  <  co  X  *  Xj 

All  logical  variables  are  bounded  this  way. 

A 

2  -°°  <  Xj  <_  0  Xj  *  -Xj 

3  Xj  is  a  free  variable  x^  »  Uj  -  v^ 
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m 


a  <_  Xj  <_  b 


and  Xj  is  not  reflected 


x.  +  LB. 
3  3 


or  Xj  is  reflected 


MUB .  +  LB  . 
3  3 


i 


a  <  x .  < 

“  3 


<  xj  —  a 


Xj  ♦  « 


Xj  =  -(Xj  +  LB j ) 


2.  The  Algorithm 

The  bounded  variable  simplex  algorithm  implemented 
is  as  follows  [Ref.  4,  p.  51] . 


STEP  1:  (PRICEOUT)  Determine  the  non-basic  variable. 


xq,  for  which 


MIN  (r. 


cq  “  cBB 


Nqr  r  <  0) 


If  no  such  variable  exists,  stop;  the  current 
solution  is  optimal. 


STEP  2:  (RATIO  TEST)  Evaluate  the  three  numbers  asso¬ 
ciated  with  variable  x„  chosen  in  Step  1. 

<3 

a.  OB  (this  bound  may  be  infinite) 

4 


b.  min  yi0/yiq,  yiq  >  o 


c.  min(yi0  -  UBj  )/y±q,  yiq  <  0,  UBj  finite 


where  UB.  is  the  upper  bound  associated  with  the  variable 
that  is  basic  for  constraint  i.  Note  that  if  the  upper 
bounds  are  infinite  and  there  are  no  tests  of  type  b  then 
the  ratio  test  may  fail.  In  this  case  the  solution  to  the 
problem  is  unbounded  in  terms  of  the  incoming  variable. 


STEP  3:  (UPDATE)  Depending  on  which  item  in  Step  2  is 
smallest,  update  as  follows: 

a.  Reflect  x^.  The  variable  xg  goes  to  its  opposite 

bound.  Subtract  UB^  times  column  q  from  the  right 

hand  side.  Multiply  column  q  by  -1  and  change  the 

sign  of  the  indicator  vector  element  e  to  show  that 

q 

Xg  has  been  reflected  (changed  to  its  opposite  bound) . 
No  pivot  is  required. 

b.  Let  p  be  the  minimizing  index  in  (b)  of  Step  2. 

Then  the  p-th  basic  variable  returns  to  its  old 
bound.  Pivot  on  the  element  in  row  p  and  column  q. 


c.  Let  p  be  the  minimizing  index  in  (c)  of  Step  2. 

Then  the  p-th  basic  variable  goes  to  its  opposite 

bound.  Reflect  x.  .  subtract  UB.  from  y  g ,  where 

jp  Jp  Pu 

UB.  is  the  upper  bound  associated  with  the  variable 


that  is  basic  for  row  p;  reverse  the  signs  of  y  . 

and  e.  (to  show  the  reflection)  and  pivot  on  the 
3p 

element  in  row  p  and  column  q. 


RETURN  TO  STEP  1 


D.  REVISED  SIMPLEX— PRODUCT  FORM  OF  THE  INVERSE 


H 


1.  Advantages 

Due  to  the  limited  random  access  memory  (RAM)  available 
on  the  eight-bit  microcomputer,  tableau  (matrix)  simplex 
methods  limit  problem  size.  In  order  to  solve  "large" 
problems  involving  several  hundred  variables  and  constraints, 
we  must  store  some  of  the  data  "off-line".  This  is  done 
by  reading  and  writing  data  to  non-volatile  memory  diskettes. 

COMPLETE  TABLEAU  REPRESENTATION 


B 


*N 


B_1N 


'  =N  -  CBB'1n 


basic  non-basic 
variables  variables 


B-1b 


cBB-lb 


right  hand 
side 


Figure  1. 

The  simplex  method  using  multipliers  (DANTZIG)  or 
the  revised  simplex  method  with  product- form  inverse  affords 
the  following  computational  advantages  while  providing  the 
necessary  intermediate  data  that  can  be  efficiently  read 
from  and  written  to  diskette  data  files  (see  [Ref.  1,  p. 

210])  . 
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a.  Less  data  is  recorded  from  one  iteration  to  the  next, 
which  permits  more  significant  figures  to  be  carried 


or  a  larger  problem  to  be  solved  within  the  limited 
memory  of  the  microcomputer. 

b.  Where  the  original  data  has  a  high  percentage  of 
zero  coefficients,  there  are  fewer  multiplications. 
In  the  standard  simplex  method,  each  iteration  re¬ 
quires  the  recording  of  at  least  (m+1) (n+1)  entries. 
Here,  however,  by  use  of  cumulative  multiplications, 
the  amount  of  recorded  information  is  reduced  to 
2m+l  entries. 

c.  High  speed  core  (RAM)  storage  requirements  are 
reduced. 

2.  Elementary  Matrices 

Consider  the  tableau  represented  in  Figure  1,  and 
suppose  Y  is  transformed  by  a  pivot  operation  where  the 
pivot  column  is: 


where  E 


*  (nq'*2q .  ^mq^  f  with  pivot  element  Ypq 

The  result  of  the  transformation  is  the  matrix, 
is  the  elementary  matrix: 


EY, 
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Y  Y\*  Y  V  V* 


I 


0  v^  0  ...  0 

0  v 2  0  ...  0 


0  v  0 
III 


where  v.  -  -yiq/ypq»  i  *  P  and  vp  =  l/ypg. 

Now,  since  the  elementary  matrix,  E,  is  determined 
entirely  by  the  elements  of  the  pivot  column,  the  remainder 
comprising  the  identity  matrix,  all  that  must  be  stored  is 
the  pivot  row  index  number  and  the  associated  column  vector. 
At  any  intermediate  iteration,  k,  the  product  of  these  ele¬ 
mentary  matrices  represents  the  inverse  of  the  basis: 


Ek  Ek-1  Ek-2  *  *  *  E2  Ei  ' 


2  “1 


where  is  the  elementary  matrix  corresponding  to  the 
k-th  pivot  operation. 

Now  we  will  augment  the  algorithm  previously  stated. 

1.  Since  the  basic  solution  Xg  *  B-1b  =  . .  .Ejb) ) ) 

we  can  maintain  current  at  each  iteration  by 
simply  multiplying  (on  the  left)  by  the  new  elementary 
matrix  for  that  iteration.  This  information  is  used 
in  Step  2  and  is  represented  by  YQ . 

2.  Calculating  current  relative  costs,  r  »  cN  -  CgB  ^N 
can  be  represented  by 


where 


X  *  CgB  ^  ("simplex  multipliers") 

*  ( { (cBEk)E]c_1)  ...  . 

3.  Once  the  pivot  column  is  chosen,  the  current  values 
of  the  elements  of  that  column  are  required  for  Step 
2.  Calculate: 


(Ek  <E*-i 


(EiV 


E.  DEGENERACY  AND  CYCLING 

Degeneracy  is  encountered  when  one  or  more  of  the 
elements  of  the  current  solution  (right  hand  side) ,  B-1b, 
become  zero.  Thus  it  is  possible  that  more  than  one  basis 
has  the  same  coordinates,  x.  When  degenerate  solutions 
occur,  we  can  no  longer  argue  that  the  simplex  procedure 
will  necessarily  terminate  in  a  finite  number  of  iterations 
as  is  true  in  the  non-degenerate  case  [Ref.  1,  p.  100] , 
because  the  value  of  the  objective  function  will  change  by 
an  amount  equal  to  zero  and  it  is  conceivable  that  the  same 
set  of  basic  variables  may  recur.  If  we  were  to  continue. 


with  the  same  selection  of  x 

q 


and  x. 
3P 


for  each  iteration  as 


before,  the  same  set  of  basic  variables  could  recur  after 
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k  iterations,  and  again  after  2k  iterations,  etc.,  indefintely 
This  recurrence  of  the  same  basis  is  called  "cycling", 

[Ref.  6,  pp.  68-69] .  We  choose  to  proceed  with  an  algorithm 
that  does  not  allow  cycling. 

Pivot  selection  rules  exist  which  ensure  completion 
of  the  simplex  method  within  a  finite  number  of  iterations. 

The  rule  referred  to  by  Bland  as  "a  simple  finite  pivoting 
rule"  [Ref.  3]  is  stated  as  follows: 

1.  Among  all  candidates  to  enter  the  basis,  select  the 
variable  x^  having  the  lowest  index,  i.e.,  pivot  on 
the  column  q  determined  by: 


y0q  =  min{yoj:  yQj  <  0}  . 


2.  Among  all  candidates  to  leave  the  basis,  select  the 

Variable  x.  having  the  lowest  index,  i.e.,  pivot  in 
3P 

the  row  p  determined  by: 


ys0  Y i0 

p  »  min{s :  y  >  0  and  - —  =  mini- — :  y.  >  0}}  . 

H  *sq  *iq  H 


Since  we  have  added  a  second  possible  pivot  option  in 
the  bounded  variable  simplex  method,  we  must  modify  this 
last  statement  as  follows: 


y-n-uB. 

ya0  yiQ  10  3: 

min{s:  - —  *  min{-±-:  y.  >  0,  - - - : 


sq 


*iq  ^ 


iq 


yiq  <  °' 


>} 


UB  . 


finite 


Note  that  in  either  case  the  row,  p,  contains  the 
first  occurrence  of  the  minimum  positive  ratio. 

It  has  been  shown  on  small  test  problems  that  imple¬ 
mentation  of  Bland's  rule  may  cause  a  significant  increase 
in  the  number  of  iterations  required  to  complete  the 
problem  [Ref.  7] .  Current  research  by  Brown  and  Dewald 
[Ref.  8] ,  suggests  a  hybrid  rule  that  restricts  the  pricing 
rule  only  when  the  current  solution  is  degenerate.  Looking 
again  at  Step  1  of  this  rule  we  will  expand  the  procedure 
as  follows: 

a.  Define  a  permutation  set  of  the  column  indices: 

K  *  {k^,...,  k. kn>,  with  a  partition  after  kg. 

b.  Assign  the  partition  boundary  s  -  0. 

c.  If  the  minimum  positive  ratio  encountered  in  Step  2 
of  the  previous  pivot  is  non-zero,  indicating  that 
the  current  solution  is  non-degenerate,  set  s  =  0 
and  select  the  variable  x  by  the  original  most 

q 

negative  rule. 

d.  If  the  minimum  positive  ratio  encountered  in  the 
previous  step  equals  zero  then  the  current  solution 
is  degenerate.  Select  x^  by  Bland's  rule  #1  such 
that: 

*  1.  If  s  *  0  then  q  =  k.  where  j  is  minimized: 

3 

MIN { j :  yQk  ^  0*  J  *  l#«».#n}  . 

3 
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2.  If  the  minimum  positive  ratio  =  0,  Bland's  rule  is 


used  until: 

*  i.  the  minimum  positive  ratio  >  0. 

*  ii.  optimality  is  verified. 

*  iii.  primal  unboundedness  is  discovered. 

By  Bland's  rule  this  will  occur  in  a  finite  number  of  pivots. 

3.  Once  the  pivot  is  completed  for  some  ratio  greater 
than  zero,  the  simplex  method  can  not  revisit  any 
previous  basis.  The  algorithm  has  moved  to  a  new 
basis  corresponding  to  an  improved  value  of  the 
objective  function. 

4.  Therefore,  the  monotonicity  of  the  objective  function 
value  implies  that  the  algorithm  terminates  in  finitely 
many  pivots. 

F.  REINVERSION 

A  characteristic  of  the  product-form  inverse  algorithm 
is  that  with  each  pivot  an  increasing  amount  of  work  must 
be  done  in  order  to  apply  the  elementary  transformations. 

The  addition  of  each  elementary  transformation  vector  in¬ 
creases  the  number  of  multiplications  in  the  next  iteration 
by  as  much  as  twice  the  number  of  constraints  in  the  problem. 
At  some  point  it  becomes  more  efficient  to  replace  the  list 
of  vectors,  commonly  referred  to  as  (ETA) ,  with  a  smaller 
set  representing  the  same  basis. 

It  is  convenient  to  again  transform  the  right  hand  side 
b'  at  this  point  to  accommodate  reflections  of  variables 
with  upper  bounds  as  follows: 
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For  each  reflected  variable  x.: 

J 


bi  =  bi  ~  I  aij  *  MUBj/  for  all  i, 

where  a^^  are  the  original  non-zero  problem  elements. 
Hellerman  and  Rarrick  [Ref.  2] ,  present  a  statement  of 
the  reinversion  problem  as  follows: 

Given — a  set  of  basic  variables 


Find — a  set  of  transformation  vectors  (ETA)  which 
imply  the  inverse  of  the  basis  in  such  as  way  as  to: 

*  a.  minimize  the  number  of  non-zero  elements  in 

ETA  and 

*  b.  minimize  the  work  done  in  forming  the  ETA. 

This  is,  of  course,  extremely  expensive  to  do  optimally. 

Starting  with  Markowitz’s  observations  [Ref.  9]  on 
minimizing  the  number  of  non-zero  elements  when  forming 
the  ETA  vectors,  Hellerman  and  Rarrick  develop  a  fast  and 
efficient  heuristic  algorithm  called  the  "preassigned  pivot 
procedure".  This  development  shows  that  if  the  rows  and 
columns  of  the  basis  matrix  can  be  re-ordered  so  that  a 
pivot  sequence  can  be  assigned  progressing  down  the  diagonal 
of  the  transformed  matrix  M,  where  M  is  lower  triangular 


with  non- zero  diagonal  elements,  then  no  additional  non¬ 


zero  elements  are  generated  in  the  ETA  representation. 


mm? 


PREASSIGNED  PIVOT  MATRIX  REPRESENTATION 


Figure  2. 


In  general,  the  lower  triangular  form  cannot  be  achieved 
but  only  approximated.  Some  of  the  columns  of  M  will  have 
non-zero  elements  above  the  diagonal.  These  columns  are 
called  "spike  columns".  In  fact  at  some  point  in  the 
process  there  will  usually  remain  a  set  of  spike  columns 
called  the  "bump"  so  that  the  matrix  can  be  represented  as 
shown  in  Figure  2. 

In  Sections  A  and  E  we  have  found  pivots  on  the  main 
diagonal  and  all  other  non- zero  elements  are  below  the 
diagonal.  Section  B  has  all  elements  equal  to  zero. 

Section  C  is  the  bump. 

Note  that  Sections  A  and  E  have  zero  multipliers  as  we 
proceed  down  the  diagonal.  The  major  problem,  then,  is 
the  build-up  of  non-zero  elements  in  Sections  C  and  D.  This 
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build-up  can  be  minimized  by  breaking  Sections  C  and  0 
into  two  or  more  bumps  so  that  the  non-zero  build-up  occurs 
only  in  the  smaller  bumps.  The  process  of  selection  of 
each  spike  in  the  preassignment  procedure  is  to  choose  the 
next  pivot  column  so  that: 

a.  when  its  effect  is  removed  from  the  row  counts 
(number  of  non-zero  elements  in  each  row  not  already 
assigned  to  the  pivot  sequence) ,  it  will  create  a 
maximum  number  of  row  counts  of  unity  or,  at  least, 
as  many  small  row  counts  become  smaller  as  is 
possible,  and 

b.  the  chosen  column  can  be  pivoted  as  soon  as  possible 
(thereby  being  updated  by  the  smallest  subset  of  ETA) . 

The  concept  of  a  tally  function  is  used  in  the  algorithm 
to  effect  the  above  goals.  The  function  is  defined  by: 

-  tk(n)  «  the  number  of  non-zeros  that  column  n  has  in 
rows  whose  row  count  is  less  than  or  equal  to  k,  for 
all  n  {all  columns  not  already  assigned  a  position 
in  the  column  pivot  sequence  or  designated  as  a 
spike  column}.  The  (k,n)  combination  giving  the 
maximum  t^Cn)  selects  the  pivot  column. 

Two  other  considerations  are  also  mentioned  in  connection 
with  the  preassigned  pivot  procedure  [Ref.  2].  If  during 
the  scan  of  column  counts,  a  column  with  a  count  of  zero  is 
found,  then  a  singularity  exists  in  the  current  basis.  The 
column  should  be  dropped  from  the  basis.  Similarly,  when 


scanning  the  row  counts,  if  a  row  count  of  zero  is  found 
in  an  unassigned  row,  then  the  associated  constraint  is 
redundant  and  could  be  removed  from  the  problem  or  repre¬ 
sented  by  a  basic  artificial  with  value  zero.  The  other 
consideration  is  that  in  computer  implementations,  if  the 
updated  pivot  element  becomes  too  small  (machine  zero)  to 
be  used  for  a  pivot  then  it  is  necessary  to  find  an  alter¬ 
nate  pivot  element.  This  can  be  done,  in  theory,  by  a 
proper  choice  of  an  alternate  spike  pivot  column  (Ref.  2] 

(a  "spike  swap”) .  Another  method  is  to  use  Gaussian  partial 
pivoting,  find  another  row  in  the  current  column  having  a 
favored) le  pivot  element  and  continue.  This  may 
lead  to  a  compromise  of  our  original  goals  and 
introduce  additional  spikes.  A  third  alternative  is  to 
replace  the  current  basic  column  with  a  logical  variable 
(unit  vector)  column  having  unity  in  the  pivot  row.  Note 
that  this  technique  may  introduce  an  infeasibility  in  which 
case  a  post- re inversion  return  to  Phase  I  will  be  required. 
The  initial  implementation  of  this  system  will  include  all 
three  options.  Although  the  "spike  swap"  technique  seems 
to  be  the  preferred  procedure  it  requires  updating  of 
multiple  columns.  For  this  reason  the  partial  pivot  proce¬ 
dure  is  tried  first  followed  by  the  spike  swap  if  no  non¬ 
zero  elements  are  found.  When  both  of  these  techniques 
fail,  the  unit  vector  insertion  is  used  as  a  last  resort. 


IV.  IMPLEMENTATION 


The  implementation  uses  a  KAYPRO  II,  8-bit  microcomputer 
with  64K  random  access  memory  and  two  single-sided,  double 
density  5-1/4  inch  floppy  diskette  drives.  Approximately 
57K  of  this  memory  is  available  for  program  loading  and 
storage  of  variables.  The  diskette  drives  are  used  for 
subroutine  storage  as  well  as  off-line  storage  of  the 
problem  files  and  the  product-form  representation  of  b""1. 

The  remaining  7K  of  internal  memory  is  utilized  by  the 
operating  system.  The  language  in  which  the  code  is  written 
is  a  "semi-standard"  version  of  Pascal.  The  programming 
package,  JRT  PASCAL  version  3.0,  is  very  nearly  a  complete 
version  of  Pascal  as  initially  designed  by  Wirth  (e.g., 

[Ref.  10]).  The  JRT  version  has  numerous  extensions  that 
make  file  handling  on  the  microcomputer  relatively  simple. 

The  major  disadvantage  of  this  language  package  [Ref.  11]  is 
that  the  code  is  never  completely  compiled  and,  therefore, 
requires  a  resident  "exec"  driver  which  interprets  the  semi¬ 
compiled  code.  This  exec  occupies  24K  of  the  usable  memory 
and  executes  less  efficiently  than  completely  compiled  object 
code.  An  additional  disadvantage  of  this  language-machine 
combination  is  that  the  KAYPRO  II,  without  an  available 
modification,  has  a  Z-80  processor  that  runs  at  a  speed  of 
only  2.5  MHz.  This  relatively  slow  processor  speed  has  an 
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obvious  effect  on  solution  times,  and  motivates  the  developer 
to  organize  programs  in  small,  easily  compiled  externally 
linked  Pascal  procedures. 

A.  DATA  STRUCTURES 

The  data  structures  used  in  this  implementation  are 
quite  simple.  They  consist  of  a  number  of  one-dimensional 
vectors  of  dynamic  length,  and  data  files  which  are  recorded 
on  non-volatile  memory  diskettes .  The  size  of  the  vectors 
is  determined  by  the  number  of  variables  and  constraints  of 
the  problem.  The  size  of  the  data  files  is  dependent  on 
the  number  of  non-zero  problem  elements  and  the  number  of 
iterations  (pivots)  performed.  To  illustrate  the  structure 
a  listing  of  arrays  and  variables  follows: 

-  Major  data  types:  Listed  in  Pascal  format  for  con¬ 
venience,  the  data  types  defined  as  records  consist  of 
two-dimensional  arrays  of  elements  that  may  be  accessed 
with  a  single  "read"  statement.  This  Pascal  convention 
is  of  great  value  when  reading  from  and  writing  to 
off-line  files. 

*  real 

*  integer 

*  boolean 

*  matrix  *  record 

a:  real;  non-zero  problem  element 

iar:  integer;  row  index  of  the  prohlem 

element 
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*  etavec  =  record 

etas:  real;  non-zero  elementary  matrix 

element 

ieta:  integer;  row  index  of  the  elementary 

matrix  element. 

*  ranges  =  record 

lb,  mub:  real;  lower  bound  for  variable 

modified  upper  bound 
(UB  -  LB)  for  variable)  . 

Array  variables: 

*  bounds:  array  of  type  *  ranges;  variable  bounds. 

*  c:  array  of  reals;  initial  cost  coefficients. 

*  e:  array  of  integers;  status  of  variables, 
basis  or  non-basic,  or  removed  from  consideration 


in  the  problem.  Reflections  are  indicated  by  the 
sign  of  the  element,  negative  indicating  a 
reflected  variable. 

*  jbasic:  array  of  integers;  variable  basic  for  the 
each  constraint . 

*  ka:  array  of  integers;  random  record  number  of 
first  element  of  each  column.  The  random  record 
number  is  the  location  key  into  a  random  access 
diskette  fils  and  indicates  the  logical  record 
number  at  which  to  enter. 

*  ke:  array  of  integers;  random  record  number  of 
first  eta  element  in  the  eta  vector  for  each  pivot . 


*  kj :  array  of  integers ;  row  number  for  each 
pivot. 

*  xb:  array  of  reals;  current  right  hand  side, 

B-1b. 

*  tc:  array  of  reals;  current  column  of  the  tableau, 

*  tls  array  of  reals;  current  simplex  multipliers, 

*  rside:  array  of  reals;  initial  [untrans formed] 
right  hand  side,  b. 

*  unitvec:  array  of  integers;  index  of  original  logical 
column  for  row  i. 

*  cycle:  array  of  integers;  hybrid  Bland's  rule 
vector  for  pricing  with  degeneracy. 

-  File  variables:  (dimensioned  2  by  the  number  of  file 
elements) 

*  eta:  type  etavec 

a  B  inverse  matrix  element 
from  etavec  data  type . 

*  ele:  type  matrix 

a  problem  matrix  element 
from  matrix  data  type  . 

B.  INPUT 

Input  to  the  problem  solver  is  accomplished  through  the 
use  of  three  subroutines.  These  include  an  interactive 
session,  "TYPEPROB",  during  which  prompts  are  given  regarding 


required  data  input  procedures  and  options;  a  module, 
"MODPROB",  which  transforms  the  formulation  into  canonical 
form  and  sets  certain  vector  parameters,  and  a  "READPROB" 
subroutine  which  creates  the  final  formatting  of  the  problem 
Initial  problem  input  may  also  be  created  using  any 
simple  word  processor  and  the  first  subroutine,  "TYPEPROB" , 
may  be  omitted  by  menu  selection.  The  format  required  for 
the  file  is  illustrated  in  Appendix  A. 

The  problem  data  used  in  the  example  throughout  this 
chapter  is  taken  from  the  bounded  variable  example  of 
Luenberger  [Ref.  4],  page  52.  This  problem  statement  is 
included  in  Appendix  A. 

1.  TYPEPROB 

This  subroutine  is  designed  to  create  a  diskette 
text  file  of  the  problem  formulation.  An  interactive,  menu 
driven  series  of  prompts  is  used  to  explain  the  input  re¬ 
quirements  and  options  of  the  input  system.  Appendix  B 
displays  a  sample  input  session. 

Upon  answering  the  first  question  posed  by  the  pro¬ 
gram  with  (1) ,  to  input  a  new  problem,  the  user  will  be 
asked  to  specify  a  problem  name.  This  name  must  be  EXACTLY 
eight  characters  long.  In  the  current  implementation  this 
is  a  file-naming  restriction. 

The  prompt  will  then  present  a  series  of  text  pages. 
Appendix  B  illustrates  these  pages.  When  the  user  completes 
his  responses  to  these  questions,  a  series  of  requests  will 
be  presented  as  follows: 


INPUT  NUMBER  OF  CONSTRAINT  ROWS 

Do  not  count  the  objective  function. 

The  user  inputs  the  integer  representation  of  the 
number  of  constraint  rows  of  the  problem  formulation. 

INPUT  NUMBER  OF  VARIABLES 

Do  not  count  logical  variables. 

DO  NOT  count  the  right  hand  side  as  a  column. 

At  this  point  more  instructions  will  be  given  on 
the  proper  procedure  for  input  of  integer  and  real  data 
types.  Then,  the  columns  will  be  accepted  from  the  user, 
one  column  at  a  time.  The  variable  associated  with  the 
column  will  first  be  named.  This  name  may  contain  up  to 
5  alpha-numeric  characters.  The  next  question  posed  will 
be  a  multiple-choice  menu  of  variable  bounds  for  the  current 
variable.  The  choices  are: 


(1) 

0 

< 

VAR 

< 

infinity 

(2) 

-infinity 

< 

VAR 

< 

0 

(3) 

VARIABLE 

IS  UNRESTRICTED 

(4) 

a 

< 

VAR 

< 

b 

(5) 

a 

< 

VAR 

<c 

infinity 

(6) 

-infinity 

< 

VAR 

< 

b. 

Simply  choose  the  appropriate  category  for  the 
current  variable.  If  the  variable  is  bounded,  then  the 


next  entries  will  be  the  lower  bound  entry,  and/or  upper 
bound  entry  as  appropriate. 


At  this  time  the  following  "heading"  will  be  pre¬ 
sented  on  the  screen. 

ROW#  /  VALUE  //  OPTIONAL  ROW  #  /  VALUE 

Negative  row  to  end  column. 

The  user  is  to  input  the  INTEGER  row  number  followed 
by  the  REAL  value  of  the  NON-ZERO  element  in  the  specified 
column  and  row.  An  additional  row  number  and  value  is 
allowed  as  long  as  the  column  number  does  not  change.  ALL 
ROWS  OF  THE  CURRENT  COLUMN  MUST  BE  INPUT  AT  THIS  POINT. 

This  includes  the  objective  coefficient  for  this  column  as 
well  as  the  coefficients  of  the  column's  constraint  elements 
Additionally,  more  than  one  objective  coefficient  may  be 
entered  at  this  time.  This  is  to  allow  for  maximum  and 
minimum  problems  to  be  entered  using  the  same  constraints 
but  different  objective  functions. 

When  a  -1  is  entered  in  the  next  row  entry  position, 
the  column  will  be  terminated  and  the  next  column  will  be 
presented.  When  all  variable  columns  have  been  entered 
the  format  of  the  entries  will  be  changed  to  outline  the 
input  required  for  the  right  hand  side  entries.  This  format 
will  be: 


For  RHS  #1,  ROW  #  1 

ENTER  G  L  or  E 
FOR  >*  <»  * 

FOLLOWED  BY: 

<SPACE>,  value  of  RHS,  < RETURN > . . 
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This  prompt  will  be  presented  for  each  row.  The 
next  prompt  will  then  ask  if  another  RHS  column  is  to  be 
entered.  Thus,  multiple  right  hand  side  columns  are  accommo 
dated.  In  this  way  multiple  problems  using  the  same  matrix, 
A,  do  not  need  to  be  re-entered  for  each  objective  and 
right  hand  side  that  might  apply.  When  no  more  right  hand 
side  columns  are  required  the  subroutine  will  terminate  and 
the  program  will  request  information  concerning  the  objec¬ 
tive  function  and  right  hand  side  to  be  considered  for  the 
imminent  solution. 

The  file  that  results  from  this  subroutine  is  stored 
on  the  diskette  in  the  form  shown  in  Appendix  A.  The  name 
of  the  file  is  Brprobname.TMP,  where  "probname"  is  the  eight 
character  name  entered  by  the  user.  If  this  file  is  con¬ 
structed  manually  without  the  use  of  the  subroutine,  then 
the  appropriate  name  must  be  given  to  the  file  so  that  the 
program  can  find  it  on  the  "B:"  diskette  in  the  future. 

This  file- naming  procedure  which  includes  the  diskette  index 
is  not  specific  to  the  KAYPRO  II  but  is  endemic  to 
microcomputers . 

2.  MODPROB 

At  the  termination  of  the  subroutine  "TYPEPROB" 
or  if  the  selection  is  made  to  re-run  a  problem  that  has 
been  previously  entered,  then  the  subroutine  "MODPROB"  will 
be  called.  This  subroutine  will  modify  the  format  of  the 
problem  file  to  include  only  that  right  hand  side  and  that 


objective  function  applicable  to  this  specific  problem. 

It  will  also  add  the  appropriate  logical  variables  to  the 
column  list.  This  new  set  of  non-zero  problem  elements  will 
then  be  written  to  a  new  text  file,  B : probname . DAT ,  for 
use.  Additionally,  the  first  set  of  basic  variables  will 
be  listed,  by  column  number,  with  negative  column  numbers 
representing  artificial  variables  and  indicating  that  Phase 
I  simplex  will  be  required.  An  example  of  this  DATa  file 
is  shown  in  Appendix  C. 

This  subroutine  also  allocates  dynamic  storage  for 
vectors  and  writes  a  file  listing  variable  names.  The  user 
will  notice  a  delay  during  the  time  "MODPROB"  is  working. 

A  large  portion  of  that  time  is  due  to  the  naming  of  logical 
variables.  The  naming  routine  is  slow  in  this  implementation 
due  to  inefficiencies  in  the  JRT  PASCAL  structure . (not  an 
important  consideration  in  the  development  of  the  basic 
algorithms) .  There  are  faster  ways  to  name  the  logical 
variables,  but  a  better  method  was  not  found  for  JRT  PASCAL. 

3.  READPROB 

This  subroutine  completes  the  reading  of  the  problem 
data  file  into  a  working  file  that  is  random  access, 
binary  and  unreadable  to  a  text  editor.  This  is  a  fast 
access  off-line  file  from  which  the  appropriate  non-zero 
elements  of  a  column  can  be  accessed  when  a  column  update 
is  required  during  the  simplex  procedure.  Upon  termination 
of  the  "READPROB"  subroutine,  the  problem  has  been  transformed 
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to  canonical  form  and  all  initial  values  have  been  set. 

The  problem  is  now  ready  for  the  simplex  technique. 

C.  THE  PROBLEM  SOLVER 

The  simplex  algorithm  implemented  is  a  "textbook" 

Pascal  translation  of  the  theory  and  approach  already  dis¬ 
cussed.  A  modular,  procedure-calling  technique  is  used 
which  allows  compilation  of  small  units  of  code,  linked 
as  external  Pascal  procedures.  A  short  description  of 
each  procedure  follows. 

1.  SIMPLEX 

The  simplex  procedure  is  the  driver  for  the  problem 
solver.  It  determines  the  requirement  for  Phase  I  or  Phase 
II,  initializes  the  required  objective  (cost)  vector  and 
calls  all  of  the  other  procedures  directly  associated  with 
the  simplex  algorithm. 

2.  PHASE I 

This  procedure  solves  the  modified  problem 

Minimize  £  x- 

j  artificial 

subject  to  the  given  constraints, 

arriving  at  a  first  feasible  solution.  If  no  such  solution 
exists  and  the  problem  is  infeasible  then  the  most  feasible, 
last  iteration  solution  is  output  and  the  program  is  ter¬ 
minated.  If  a  feasible  solution  is  found,  then  the  original 
problem  cost  vector  is  restored  and  Phase  II  simplex  is  begun 


3.  BTRAN 


The  "BTRAN"  subroutine  calculates  the  simplex 
multipliers 


A  =  cbB 

using  the  formula  (...({( c^E^)  Ek_1)...)E1)  . 

A  copy  of  the  Pascal  code  for  "BTRAN"  is  included 
in  Appendix  D  as  an  example  of  the  implementation  code. 

4 .  CHUZQ 

After  "BTRAN"  computes  the  simplex  multipliers,  this 
procedure  is  called  to  calculate  the  current  reduced  costs 
for  all  non-basic  variables,  cN  -  AN.  In  the  absence  of 
degeneracy  the  most  negative  reduced  cost  over  all  is 
chosen,  resulting  in  the  most  rapid  convergence  to  the 
optimal  solution.  In  the  presence  of  degeneracy  the  hybrid 
implementation  of  Bland's  rule  number  1  is  activated. 

5.  FTRAN 

This  procedure  is  called  at  any  time  that  a  column 

vector  update  is  required.  The  function  calculates, 

Y  *  B_1A„  using  the  formula 
q  <1 

EkCEk-lC  ^lV*  • 

6.  CHUZP 

Using  an  updated  column  from  "FTRAN",  "CHUZP" 
determines  the  pivot  row,  p,  using  the  three-case  test 
for  bounded  variables. 


7.  PIVOT 


This  procedure  is  called  by  the  simplex  subroutine 
and  by  the  "REINVERT"  procedure.  Each  time  "PIVOT"  is 
called,  an  asterisk  (*)  is  displayed  on  the  CRT  for  refer¬ 
ence.  Each  asterisk  signifies  the  formation  of  one  ETA 
vector  in  the  B-^  product-form.  If  case  a  of  the  bounded 
variable  simplex  algorithm  is  encountered  and  a  non-basic 
variable  is  reflected,  (no  eta  vector  is  generated) ,  then 
a  pound  sign  (#)  is  printed  in  place  of  the  asterisk. 

8.  REINVERT 

"REINVERT"  is  a  direct  implementation  of  Hellerman 
and  Rarick's  preassigned  pivot  procedure  with  a  few  modifi¬ 
cations.  Forward  pivots  are  completed  as  they  are  assigned 
so  that  subsequent  forward  transformations  can  be  used 
iimnediately  to  reveal  scaling  difficulties  requiring  spike 
swapping  (pivot  element  too  small) .  Constraint  redundancy 
checks  are  also  implemented  as  described  in  [Ref.  2] ,  page 
214. 


D .  OUTPUT 

The  "FILEOUT"  procedure  causes  the  current  solution  to 
be  written  to  the  output  file,  BjPFI.LST.  At  program 
termination  this  text  file  may  be  printed  using  any  simple 
word  processor.  An  example  of  the  program  output  for  the 
example  problem  is  shown  in  Appendix  E. 

This  procedure  reverses  most  transformations  used  to 
convert  to  (LPC) .  Thus,  upper  and  lower  variable  bounds, 
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free  variables,  and  the  extremal  operator  (min/max)  appear 
on  the  report  as  they  did  in  the  original  formulation. 
Constraints  appear  with  non-negative  right  hand  sides.  The 
report  also  lists  reduced  costs  for  non-basic  variables  and 
dual  prices  for  constraints  with  structural  variables 
basic. 


V.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  simplex  implementation  described  has  shown  that 
advanced  algorithms  for  linear  programming  problems  can  be 
packaged  in  an  easy  to  use,  interactive  system  on  a  micro¬ 
computer.  It  has  also  shown  that  while  solution  time  is 
certainly  not  on  the  same  order  of  magnitude  offered  by 
mainframes,  neither  is  there  the  cost  associated  with  main¬ 
frame  CPU  time-sharing.  Reasonable  solution  time  for  a 
linear  program  on  a  microcomputer  might  be  the  length  of  a 
coffee  break.  This  implementation  averages  three  to  four 
seconds  per  pivot  for  early  iteration  pivots  and  approximately 
5  seconds  after  thirty  pivots. 

A  time  test  was  run  on  a  problem- posed  by  MICRO  VISION 
(135  Herzel  Blvd.,  Lindenhurst,  N.Y.  11757)  as  an  advertise¬ 
ment  for  their  "MATHEMATICAL  PROGRAMMING  PACKAGE  II".  This 
problem  restated  as  a  bounded  variable  problem  has  8  con¬ 
straints  and  17  variables,  including  logicals.  The  original 
A-matrix  is  85  percent  dense.  Total  solution  time  on  the 
KAYPRO-II  at  2.5  MHz  clock  speed  was  125  seconds.  This  time 
included  30  seconds  required  to  write  three  solutions.  Phase 
I,  Phase  II,  and  the  reinversion  solution.  Phase  I  and 
reinversion  times  were  also  included  in  the  solution  time. 

While  these  times  are  not  as  good  as  the  MICRO  VISION  time 
published,  the  limit  on  the  number  of  variables  and  constraints 
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for  the  MICRO  VISION  version  is  listed  as  "100  x  100  on  the 
IBM  Personal  Computer  or  model  XT  with  128K  memory".  The 
limit  on  constraints  and  variables  for  the  description 
given  in  this  paper  has  not  been  reached.  The  limiting 
factors  are  the  number  of  elements  in  the  one-dimensional 
vectors  required  for  the  underlying  data  structure  and  the 
size  and  density  of  the  diskettes  used  to  store  the  out-of¬ 
core  files. 

Serial  file  organization  of  the  problem  and  eta  files  on 
diskettes  would  greatly  improve  performance.  This  modifi¬ 
cation  would  require  organization  of  these  filtes  in  "pages" 
of  columns  to  permit  efficient  serial  reading  of  a  (problem 
dependent)  set  of  columns  at  each  diskette  access.  In 
concert  with  this  modification,  partial  pricing  ("batch 
pricing")  would  probably  improve  execution  efficiency  a  bit 
more.  Unfortunately,  these  relatively  easy  modifications 
require  significant  redesign  of  dynamic  memory  management 
and  file  handling  constraints.  These  enhancements  have  not 
been  implemented  at  this  writing. 

We  hope  that  the  work  presented  here  will  further  stimu¬ 
late  the  development  of  additional  mathematical  programming 
software  for  use  on  microcomputers.  As  costs  of  micro¬ 
computers  continue  to  decrease  while  system  capabilities 
progress,  the  operations  research  community  must  be  prepared 
to  take  full  advantage  of  the  availability  and  potential  of 
these  valuable  tools. 
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Copies  of  the  PASCAL  code  and  diskettes  formatted  for 
the  KAYPRO  II,  containing  all  subroutines  may  be  obtained 
from  the  author.  Please  address  requests  to: 


Major  D.  W.  Theune 
P.  0.  Box  1083 

Springfield,  Va.,  USA  22151. 
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APPENDIX  A 
EXAMPLE  INPUT  FILE 

PROBLEM  STATEMENT 


minimize  2x.  +  x,,  +  3x,  -  2x.  +  10xc 
1  2  3  4  5 


subject  to  x1 


+  X-5  —  x.  +  2xc  =  5 

3  4  5 


x2  +  2x^  +  2x^  +  x5  =  9 


0  £  X^  £7,  0  £  X2  £  10,  0  <_  X3  <_  1,  2lx4l5r  0  £  X5  £  3 


EXAMPLE  INPUT  FILE 


2  5 

2  11  3  2 

2  2  1  3  1 

3  11  2  2 

3  3  3 

4  1-12  2 

4  3-2 

5  12  2  1 

5  3  10 

1  e  5 

1  e  9 


XI  4 

X2  4 

X3  4 

X4  4 

X5  4 


number  of  constraints  /  number  of  variables 
<  no  blank  space  here  > 


non- zero  problem  elements 
format ; 

/  optional 

col  #  /  row  #  /  value  /  row  #  /  value 

<  blank  space  required  > 
right  hand  sides 

rhs  #  /  restriction  /  value 

<  blank  space  required  > 


variable  name  /  type  of  bounds 
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APPENDIX  B 


INTERACTIVE  SESSION 


CRT  SCREEN  PRESENTATION  Is 


A>b:  axac  pft 
Exac  v or  3.0 


DEBUS? 


1  ■  yam 


Do  you  wish  to: 

(1)  input  a  mm  problaa? 

(2)  ra-run  an  old  problaa  with  aodif 1 cations? 


TYPE  YOUR  CHOICE  1  or  2 


Input  tha  problaa  naaa. 

This  naaa  will  ba  usad  whanavar  tha  problaa  ia  racallad 

format: 

antar  EXACTLY  aight  charactara.  Pwyl’mr 


SCREEN  2 


THIS  PROGRAM 


I  IS  INTENDED  TO  BUILD  A  DATA  FILE  FOR  PRESENTATION  OF 
A  LINEAR  PROGRAM  TO  THE  PACKAGE  THESIS. PFI 


I#  you  want  to  contlnua  typa  "go"  and  <antar>. 

I#  you  hava  alraady  antar ad  your  data 

or  If  tha  data  fila  you  wiah  to  uaa  haa  alraady  boon  craatad 
than  typa  "roturn"  and  <antor>  to  rat urn  to  tha  aain  prograo. 


1 


SCREEN  3 


THIS  PRO©* AM  IS  INTERACTIVE: 

PROMPTS  WILL  BE  GIVEN  AS  FOLLOWS: 


The  first  two  sntriss  Mill  bs  ths  NUMBER  OF  ROMS  and  COLUMNS. 


Raaaining  sntriss  Mill  bs  entsrsd  in  •  aodlfiad  coluan  input  for sat 
Coluans  Mill  bs  rsquastsd  in  ordar. 

You  Mill  sntsr  ths  currant  rou  nuabsr  of  ths  nsxt  non-zsra  valus 
and  ths  valus  assoclatsd  Mith  that  coluan  and  roM. 


Rom  #  /  Valus  //  Optional  Rom  •  /  Valus 


note:: 

Currant  coluan  nuabars  Mill  bs  providad.  If  all  roas  for  ths  currant 
coluan  hava  boon  antsrsd,  typs  "-1"  for  ths  nsst  roa  nuabsr  and  ths 
coluan  nuabsr  Mill  bs  incraaantad. 


TYPE  ANY  CHARACTER  and  < sntsr  >  TO  CONTINUE 
f 


SCREEN  4 


INPUT  NUMBER  OF  CONSTRAINT  ROHE 


2 


Do  not  count  ths  obj 


tiva  function!!!! 


INPUT  NUMBER  OF  VARIABLES 

DO  NOT  COUNT  LOGICAL  VARIABLES! ! ! ! 

DO  NOT  ENTER  LOS I CAL  VARIABLE  COLUMNS!!!!!! 


V 


SCREEN  5 


YOU  MILL  NON  BE  ASKED  TO  ENTER  THE  NON-ZERO  PROBLEM  ELEMENT!}. 

All  entries  Mill  be  entered  by  coluan. 

A  RESTRICTED  nuatoar  of  ram  and  cal uanB  aay  ba  antarad. 

Tha  first  2  rows  of  each  coluan  represent  the  non— objective 
roMS.  All  additional  roes  antarad  Mill  ba  treated  as  additional 
abjective  rows.  You  Mill  be  asked  later,  which  objective  function 
is  to  ba  considered  in  a  given  problea  solution. 

A  MAXIMUM  OF  10  OBJECTIVE  ROWS  MAY  BE  ASSI8NED  TO  A  GIVEN  PROBLEM. 
similarly: 

Tha  first  S  coluans  Mill  ba  treated  as  variables.  All  raaaining 
coluana  Mill  ba  assuaed  as  independent  sets  of  technological  constraints. 
You  Mill  ba  asked  later,  which  of  these  sets  is  to  be  considered  for 
the  current  problea  solution. 

TYPE  ANY  CHARACTER  and  <anter>  TO  CONTINUE 


SCREEN  6  (DATA  .INPUT) 

Tha  follOMlng  entries  aay  pe  placed  IN  ORDER  in  any  coluan. 

The  following  restrictions  apply: 

All  roM  nuabers  aust  be  entered  as  integers. 

All  values  aust  ba  entered  as  real  nuabers  as  follows; 

S. 123  or  2.34  or  34.0  .  The  deciaal  aust  have  a  proceeding 

and  a  following . nuaeral . 


ENTER  NON: 

Current. coluan  is  1 

Type  up  to  S  characters  to  assign  variable  naaa  for  coluan  1 
XI 


Chooee  appropriate  variable  bounds  far  variable  Xl 


ui 

LB 

0  <-  XI  <- 

UB 

infinity 

(21 

-infinity  <»  XI 

<- 

0 

(31 

XI  unrestricted  (FREE) 

(41 

a  <-  XI 

<• 

b 

(31 

a  <-  XI 

<« 

infinity 

(41 

-infinity  <■  XI 

<» 

b 

TYPE 

4 

(1  or  2  or  ...  41 

MHAT  18  THE  LOWER  BOUND? 

a  a 

LB. 

• 

NHAT  18  THE  UPPER  BOUND? 

b  -  UB. 

64 


ROM  *  /  VALUE  //  OPTIONAL  ROM  •  /  VALUE 

Negative  row  to  and  coluan 
113  2 

Last  row  ontarad  was  objactiva  row  •  1 
-1 

Currant  coluan  is  2 

Typa  up  to  S  charactars  to  assign  variable  naaa  -for  coluan  2 
X2 

Choosa  appropriate  variable  bounds  -for  variable  X2 


LB 

UB 

(1) 

0  <-  X2 

<■  infinity 

(2) 

-infinity  <- 

X2 

<- 

0 

(3) 

X2  unrestricted 

(FREE) 

(4) 

a  <- 

X2 

<■ 

b 

(3) 

a  <• 

X2 

<- 

infinity 

(A) 

-infinity  <- 

X2 

<- 

b 

TYPE  (1  or  2  or  ...  6) 

4 

WHAT  IS  THE  LONER  BOUND?  a  -  LB. 


WHAT  IS  THE  UPPER  BOUND?  b  -  UB. 

10 

ROM  •  /  VALUE  //  OPTIONAL  ROM  •  /  VALUE 

Negative  raw  to  and  coluan 
2  13  1 

Last  row  entered  was  objactiva  row  •  1 
-1 

Currant  coluan  is  3 

Typa  up  to  3  charactars  to  assign  variable  naaa  far  coluan  3 
X3 


Choose  appropriate  variable  bounds  for  variable  X3 

LB  UB 

(!)  0  <-  X3  <-  infinity 

(2)  -infinity  <»  X3  <•  0 


(3) 

X3  unrestricted 

(FREE) 

C4> 

a  <-  X3 

<- 

b 

(3) 

a  <-  X3 

<- 

infinity 

(A) 

-infinity  <•  X3 

<- 

b 

TYPE  (1  or  2  or  ...  A) 

4 

WHAT  IS  THE  LOWER  BOUND?  a  -  LB. 

0 

WHAT  IS  THE  UPPER  BOUND?  b  -  US. 

1 

MM  •  /  VALUE  //  OPTIONAL  RON  •  /  VALUE 

Negative  row  to  and  coluan 
112  2 
3  3  -i 

Current  coluan  is  4 

Type  up  to  3  characters  to  assign  variable  naaa  for  coluan  4 
X4 


Choose  appropriate  variable  bounds  for  variable  X4 

LB 

UB 

(1) 

0  <-  X4 

<- 

inf inity 

(2) 

-infinity  <■ 

X4 

<-  0 

(3) 

X4  unrestricted  (FREE) 

14) 

a  <« 

X4 

<»  b 

IS) 

a  <- 

X4 

<■  infinity 

(6) 

-infinity  <■ 

X4 

<-  b 

TYPE 

(1  or  2  or  ...  6) 

4 

WHAT  IS  THE  LOWER 

BOUND? 

a  “  LB. 

2 

WHAT  IS  THE  UPPER 

BOUND? 

b  -  UB. 

S 

RON  t  /  VALUE  // 

OPTIONAL  ROW  «  /  VALUE 

Negative  roe  to  end 

column 

1  -1 

2  2 

3  -2 

-1 

Current  column  is  S 

Type  up  to  S  characters  to  assign  variable  name  for  column  3 

XS 

Choose  appropriate  variable  bounds  far  variable  XS 

LB 

UB 

(1) 

0  <-  XS 

<- 

infinity 

(2) 

-infinity  <*■ 

XS 

<-  0 

13) 

XS  unrestricted  (FREE) 

(4) 

a  <» 

XS 

<»  b 

IS) 

a  <* 

XS 

<«  infinity 

(4) 

-infinity  <■ 

XS 

<■  b 

TYPE 

<1  or  2  or  ...  4) 

4 

WHAT  IS  THE  LOWER 

BOUND? 

a  -  LB. 

0 

WHAT  IS  THE  UPPER 

BOUND? 

b  ■  UB. 

3 

ROM  •  /  VALUE  // 

OPTIONAL  ROW  •  /  VALUE 

Negative  roe  to  end 

n 

0 

*— 

\ 

12  2  1 

3  10 

-1 

Current  column  is  RIBHT  HAND  SIDE  •  1 

HU  rOMB  a*  N1H1I  IMW 

si*  require  an  encry. 

ENTER  type  of  constraint  folio* 

ied  by  the  value  of  the  current  RHS 

ZERO 

VALUES  AS  0.0 

For  r 

MS  •  1,  ROW  t  1 

ENTER 

8  L 

or  E 

FOR 

>-  <■ 

m 

Folio* ied  by: 

< SPACE >  ,  value  c 

»f  RHS  , 

< RETURN >. . 

(  Y  or  N  > 


Far  RHS  •  1,  ROW  •  2 

ENTER  G  L  or  E 
FOR  >«  <-  - 

Followd  by: 

< SPACE >  ,  value  of  RHS  ,  < RETURN >. . 

•  9 

RHS  1  is  comp 1st*.  Do  you  have  another  RHS  col  wan? 

<  Y  or  N  > 
n 

Zs  the  objective  to  be  Minimized  :  or  MAXimized. 

ENTER  MIN  or  MAX 

ain 

Input  the  integer  number  of  the  objective  roe  to  be  considered. 
This  integer  must  be  in  the  range  1  to  10 

1 

Input  the  integer  number  of  the  Right  Hand  Side  to  be  considered. 
This  integer  oust  be  in  the  range  1  to  number  of  RHS  columns. 

1 

Begi n  phase  1 
—•dealing  with  degeneracy 
-•dealing  with  degeneracy 

Phase  I  solution  complete. 

Do  you  wish  to  print  out  all  intermediate  solutions? 

Type  any  positive  integer  if  YES 

negative  integer  or  0  if  NO 

m 

Begin  phase  2 
dealing  with  degeneracy 
•deal ing  with  degen  eracy 
— 

Phase  II  solution  complete: 

REINVERSION  IN  PROGRESS 

** 

REINVERSION  COMPLETE 


Proaram  termination 


APPENDIX  C 


EXAMPLE  PROBLEM  FILE 


2  7 

111  32 

2  2  1  3  1 

3  11  2  2 

3  3  3 

4  1-12  2 

4  3-2 

5  12  2  1 

5  3  10 

6  11 

7  2  1 

8  15 

8  2  9 


m/n  Constraints,  variables 

This  list  is  produced  by 
the  package  and  is  not 
accessible  to  the  user. 


6 

7 


initial  basis  columns  (-)  denotes  artificials 


APPENDIX  D 


BTRAN  PROCEDURE  LISTING 


procedure  btran: 

{produca  pricing  vactor  tlCi3-  Cb  *  Binvcrw) 


i ,  J ,  fci:  intagar; 
tx:  rul| 

bag  in 

far  i I “  1  to  a  do 
bag  in 

tlCi3:-  cCjbasicCi 331 

if  (aCjbaaicCi 33<0)  than  tlCi3:-  -tlCi3| 
if  (abs<tlCi3Xzl>  than  tlCi3:-  0.0) 
and! 

If  (np  <>  0)  than 
bagin 

far  1:-  np  doanto  i  do 
bagin 

t*:»  0.0i 

for  ki:-  kaCl 3  to  kaCl+13-1  do 
bagin 

raadtbinv,  rrn,  ki|  atalf 

tx:*  tx  ♦  tl Cat a. iata3  *  ata.atas! 

and! 

if  (abs(tx)  <  zl>  than  tx:-  0.0! 
tl CkjCl 33:—  tx | 

and! 

and! 

if  (dabug)  than 
bagin 

aritalnioutfilai  'BASIC  COST  VECTOR’ ) i 
for  j:-  1  to  a  do 

aritalnioutf ilal  tlCj3f’  ’)! 

and! 

and!  iprocadura  btran} . 


\l 


APPENDIX  E 


OUTPUT  LISTING  FOR  LP  PROBLEM  SOLVER 


Output  for  pr ob  1m  bounded2 

toiling  with  daganirKy! 

Dealing  with  degeneracy! 

PhiM  X  solution  : 

The  problM  is  slnlslzs. 


Variable 


Basie 

for 

Constraint 


CCjl 

initial 


Value 


Rsducsd 

Cost 


Basle  Original 
Varlabls  RH8 


Black 

Value 


Dual 

Prices 

l.fMM 

l.fMM 


Value  of  the  objective  function  :  f 

Current  value  and  solution  represent  tableau  for  pivot  •  2 


Dealing  with 


Dealing  with  degeneracy 


V’  «  *.  i 


Opt  1  Ml  phaM  IX  solution  : 
Ths  problea  is  ainlalze. 


Var 

labia 

Basic 

CCJ  3 

Valua 

Rsducsd 

N 

4M 

for 

Constraint 

initial 

Cost 

XI 

a 

* 

2 

2.0000000000 

X2 

a 

a 

1 

1 

0. 0000000000 

X3 

a 

a 

3 

3.0000000000 

X4 

a 

a 

2 

-2 

0. 0000000000 

XS 

a 

a 

10 

0.0000000000 

1.0000000000 

Row 

Basle 

Original 

Slack 

Dual 

Variable  RH8 

Valua 

Prices 

1 

X2 

a  3 

0.0000000000 

-4.000000000 

2 

X4 

a  a 

-1.000000000 

Vslus  of  ths  ob j set 1 vs  function  :  12 

Currant  valus  and  solution  rsprsssnt  tsblaau  for  pivot  *  S 


REINVCR8I0N  AFTER  PIVOT  •  9 


AEXNVERSIQN  COMPLETE 

The  problsa  is  ainlalze. 

Variable 

Basle 

CCJ  3 

Valua 

Reduced 

Maaa 

for 

initial 

Cost 

Constraint 

xt  : 

'  2 

7.0000000000 

aa  0VWWVWV 

X2  : 

2 

1 

0.0000000000 

X3  3 

3 

3.0000000000 

X4  3 

1 

-2 

W a  ■wvvvvwv 

X9  3 

10 
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